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1.  Introduction 


Developing  and  sustaining  situational  awareness  is  an  enduring  challenge  for 
today’s  Warfighter.1  Situational  awareness,  or  knowledge  of  the  immediate  present 
environment,  is  a  daunting  task  considering  the  plethora  of  data  sources  available. 
In  particular,  an  intelligence  analyst  must  be  able  to  search  through  an  enormous 
haystack  in  a  timely  manner  to  find  the  few  valuable  needles.  The  US  Army 
Research  Laboratory  (ARL)  has  confronted  this  challenge  by  researching  and 
developing  the  Value  of  Information  (Vol)  metric.2 

The  Vol  metric  uses  a  fuzzy  logic-based  model  that  converts  the  subjective 
experience  of  subject  matter  experts  (SMEs)  into  a  range  of  scores.  Specifically, 
given  an  evaluation  of  the  source  reliability  and  information  content  of  an 
intelligence  report,  the  ARL  model  will  produce  a  Vol  score  that  approximates  the 
SME  process  for  determining  value.  Hypothetically,  this  score  will  enable  an 
intelligence  analyst  to  identify  the  most  valuable  information  necessary  to  sustain 
situational  awareness.  Simulations  conducted  by  ARL  have  demonstrated  that  the 
Vol  metric  can  increase  the  situational  awareness  of  an  intelligence  analyst  during 
a  finite  time  period.3 

In  this  report,  we  discuss  a  prototype  system  that  pushes  Vol  beyond  simulations 
and  into  the  field  environment  where  further  research  can  be  conducted.  In  general, 
the  system  consists  of  Vol-enhanced  1)  collection  tool,  2)  dissemination  service, 
and  3)  visual  analytic.  The  collection  tool  developed  by  ARL  will  be  embedded 
with  a  Soldier  that  will  enable  them  to  create  and  disseminate  Vol-rated  reports.  In 
this  scenario,  the  Soldier  is  the  data  collector  and  SME.  Their  subjective  evaluation 
of  the  of  collected  intelligence  initiates  the  Vol  rating  that  will  persist  all  the  way 
to  the  analyst.  The  dissemination  service  leveraged  in  this  prototype  is  DSPro, 
software  that  was  developed  by  the  Institute  for  Human  and  Machine  Cognition 
(IHMC)  in  collaboration  with  ARL.  Finally,  the  visual  analytic  for  this  prototype 
is  an  enhanced  version  of  Contour  (a  relationship  discovery  tool  developed  by 
Decisive  Analytics  Corporation).  The  ARL  enhancements  to  Contour  use  the  Vol 
rating  of  the  source  data  as  a  means  of  filtering  the  relationship  diagram.  The 
development  and  integration  of  each  component  will  be  discussed  in  detail  in  the 
proceeding  sections. 

In  conclusion,  the  goal  of  this  research  is  to  develop  a  prototype  system  that  will 
allow  ARL  to  evaluate  Vol  in  a  field  environment.  Simulations  already  suggest  that 
Vol  is  a  candidate  for  helping  sustain  situational  awareness,  but  field  experiments 
are  necessary  for  further  evidence.  This  prototype  provides  Vol  enhancement  at  all 
stages  from  collector  to  analyst  and  can  be  used  as  a  field  experimentation  platform. 
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2.  Developmental  Work 


This  section  outlines  the  software  development  necessary  for  building  the 
prototype.  Development  for  this  prototype  included  the  creation  of  2  Android 
smartphone  applications  (apps)  and  the  enhancement  of  an  existing  tool  (Contour). 

Prior  work  with  Android  smartphone  apps  was  leveraged  to  quickly  develop  both 
apps.4  This  allowed  for  more  time  to  test  and  refine  the  prototypes,  which  resulted 
in  a  superior  end  product. 

Enhancing  Contour  with  Vol  functionality  presented  a  unique  challenge  since  the 
system  was  largely  a  black  box  with  no  source  code  available.  With  help  from  one 
of  the  original  developers  (Scott  Martin,  Decisive  Analytics  Corporation),  Vol  and 
Contour  were  successfully  integrated. 

2.1  Spot  Report  App 

The  Spot  Report  app  was  developed  to  report  observations  from  the  field  that  could 
have  an  immediate  and  significant  effect  on  current  planning  and  operations.  The 
Soldier  using  the  app  will  also  subjectively  assign  a  Vol  score  (Fig.  1)  to  the  report. 
Finally,  the  report  is  disseminated  to  analysts  for  further  evaluation.  Please  see  the 
smartphone  app  workflow  diagram  (Fig.  2)  for  the  complete  process. 


Fig.  1  Spot  report  main  screen 
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Fig.  2  Smartphone  app  workflow 

To  begin,  the  Soldier  launches  the  app  and  is  presented  with  the  main  screen 
(Fig.  3),  where  report  content  is  recorded. 


Fig.  3  Vol  screen 

The  app  was  designed  with  simplicity  and  ease  of  use  in  mind,  consequently  some 
data  are  automatically  generated  using  the  smartphone’s  built-in  capabilities.  These 
fields  (Date,  Time,  and  Location)  are  intentionally  greyed  out  to  signify  that  they 
cannot  be  manually  edited.  The  remaining  fields  (Source,  Report,  Picture,  Audio, 
and  Vol)  are  editable  and  the  Soldier  may  complete  any  combination  of  fields 
before  submitting  the  report. 

The  following  is  an  example  of  output  disseminated  from  the  Spot  Report  app 
(DSPro  required  Extensible  Markup  Language  [XML]  format). 
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<?xml  version="l .  G"?> 

<Metadata> 

<Field> 

<F i e ldName >Messago_ID< / F i e IdName  > 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName>Receiver  Time  ,Stamp</FieldName> 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName>Raforrod  Data  Object  Id</FieldName> 

<FieldValue>APG</FieldValue> 

</Field> 

<Field> 

< F i e 1 d Nam  e >Ra f a r r ed_D at a_I n at anca_ I d< / F i e 1 d N ame > 

<F i e  Id  Va 1 ue>b7  9c5fif 3-7d2  7-4  f 3  G -addc-d7 1991 ldaf 38  < / F  ie  ldVa lue > 

</Field> 

<Field> 

<F i e ldName>&edigree  ;  / F ie IdName > 

<FieldValueX/FieldValue> 

</Field> 

<Field> 

<F i e ldName  Ref e r s_To< /F 1 eldName> 

<Field Value  >no_ref_ob J < / F i e ldVa 1 ue > 

</Field> 

<Field> 

<FieldName>Prev  Msg  ID< /Fie ldName > 

<F  i  eldVa  1  ue>D(SPro-ARL ,  DSPro .  CheckpointReport :  SAMSUNG- SM-N  90  0 A :  5<  / F ie  IdValue  > 

</Field> 

<Field> 

<F i e 1 dName> S ou cca < /Field  Name  > 

<F i e 1 d Va 1 ue ;  SAMSUNG- SM-N 9 0 0 A< / Fie Id Va 1 u  e > 

</Field> 

<Field> 

<F  i  eld  Name>Sour:ce_Tiina_S  tamp-  Tie  Id Name > 

<F ieldVa  lue> 14  6230  055  9853< /Fie ldValue> 

</Field> 

<Field> 

<F i e ldName >Expi rat ion_Time < /F ieldName> 

<FieldValue>0</FieldValue> 

</Field> 

<Field> 

<F i eldName Relevant  Mis  sion  s< / Fie ldName> 

<FleldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName>Laft  Upper  Latitude < /F i a ldName > 

<FieldValue>39 * 473900 </FieldValue> 

</Field> 

<Field> 

<F i e Id  Name  >Laf t_Uppor_Longituda< /Fie ldName > 

<FieldValue>-7 6. 114532c /Fie ldValue> 
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</Field> 

<Field> 

<F  id  d  Man  i  a  >  Right_Low©  r_Lat  i  tud©  <  /  Fid  d  K  a:  no  > 
<F id d Va  1  ue  39,473900-  L’icl dVa  1  u c > 

</Field> 

<Field> 

<F  i  q  i  d Nam  c  > Right  Low©  r  Longit  ude  <:  /  F  i  a  1  d  K a :  uo  ;■ 
<FieldValue>-76.114532</FieldValue> 

</Field> 

<Field> 

Location 

<FieidValue>]Lat:  39,47390078 

Long:  -76, 11453237</FieldValue> 

</FieId> 

<Field> 

<F i  e  IdNamd  Importance  .  /  F ie IdName  > 

<  F  i  o  _  d  Va  1  uo  >  9 , 3  3 0  0  0 0  <  /  Fid  d  V  a  1  a  e  > 

</Field> 

<Field> 

<  F  i  a  ’  d  M a  m  e  >  S  ou  r ca  Reliability  <  /  Fie’,  d  Ma  rn  a  > 

<F i e^dVa 1 ue  > 1 * 0  0Q  0  GO  < /F i eldVa i ue  > 

</Field> 

<Field> 

<F  i  e d  Marne  >  Inf  onnation_Ccjnt ant  <  /  K  i  e  '  d  Name  > 
<FieldValue>I,000000</FieldValue> 

</Fieid> 

<Field> 

< j'iel d : : a r.v. •  Data _Co n t © nt ■  did d i-J a m *  > 

<F  i  el  d  Va  ]  I j e  Spot_Repo rt <  /F  i  e  1  d  Va  1  ue> 
</Field> 

<F±eld> 

c'idddu.,.  Data.Format  ■  i  aldNamc  ■=■ 

<E''i  e'.  dVa  ue;  image/  jpeg  id  eldVa  1  iae> 

</Field> 

<FieId> 

<F i a ldName> Target_ID  < /F i eld Name > 
<FieldValuex/FieldValue> 

</Field> 

<Field> 

<F  i  ddMuni<e> Target  Role<  /  F  iddNamc  > 
<FieldValuex/FieldValue> 

</Field> 

<Field> 

<F ie Id Name > Target  Team< / F i eldName > 
<FieldValue></FieldValue> 

</F±eld> 

<Field> 

<  Fie’  d  Na  rn  e  >  Cla  s  s  i  F  ic  at  i  on  <  /  F  i  e  1  d  M  am  e  > 

<F i e^dVa 1 ue  >Unc lassif ied  :  / F i e IdValue  > 

</Field> 

<Field> 

<E''  i  e d Marne  >Dasc  riptioiK  /  V  i  e  1  d  N  ame  > 

<7 i  e d Va  Spot  Report  App  FieldVadje> 
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</FieId> 

<Field> 

<EieldKame:  Node  Typ*</FieldName> 

<FieldValue></FieldValue> 

</Field> 

<Field> 

<F ie ldName :  Tra  ck_ I D< / F i e ldN ame > 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<F  i  e  Id  Name;  Application_Mofta.da.ta<  /Fie  ldNaroe> 

<F  ie  ldValue>  {  "  Information  Source  "  :  "  John  Doe" ,  "  Report ,f :  "  Imminent  attack  " }  <  /Fie  Id Va  lue> 
</Fleld> 

<Field> 

<F ieldName > Application  Metadata  Format </FieldName> 

<F  i  e  ldVa  lue  >applicat  ion/  j  son-:  /Fie  ldVa  iue> 

</Field> 

</Metadata> 


Examining  the  XML  reveals  the  Spot  Report  content  is  located  in  the  “Application 
Metadata”  field  in  JavaScript  Object  Notation  (JSON)  format.  This  format  was 
selected  for  compatibility  with  other  tools  under  development  within  ARL.  The 
corresponding  JSON  schema  for  parsing  the  spot  report  content  is  defined  in  the 
following. 


{ 


} 


"$schema":  "http: // 

"title":  "Spot  Report", 

"descr iption" :  "Attributes  Gathered  by  SpotRep  Mobile  App" 
"type":  "object", 

"properties" :  { 

"Information  Source":  { 

"description":  "Information  Source  of  Report", 
"type":  "string" 

}, 


"Report":  { 

"description”:  "Actual  Report  Content", 
"type":  "string" 

} 


), 

"required":  ["Information  Source",  "Report"] 


2.2  Checkpoint  Report  App 

The  Checkpoint  app  was  developed  to  report  observations  from  processing  people 
through  checkpoints.  The  Soldier  using  the  app  will  also  subjectively  assign  a  Vol 
score  (Fig.  4)  to  the  report.  Finally,  the  report  is  disseminated  to  analysts  for  further 
evaluation.  The  checkpoint  workflow  is  the  same  as  the  spot  report  workflow  and 
can  be  found  in  Section  2.1. 
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Fig.  4  Checkpoint  report  main  screen 


To  begin,  the  Soldier  launches  the  app  and  is  presented  with  the  main  screen 
(Figs.  5  and  6),  where  report  content  is  recorded. 


Fig.  5  Checkpoint  report  main  screen  2 
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Fig.  6  Vol  screen  2 

This  app  was  designed  with  similar  design  principles  as  the  Spot  Report  app,  so 
again,  simplicity  and  ease  of  use  were  the  two  main  goals.  Similar  to  the  Spot 
Report  app,  some  of  the  data  is  automatically  generated  using  the  smartphones 
built-in  capabilities.  These  fields  (Data,  Time,  and  Location)  are  intentionally 
greyed  out  to  signify  that  they  can’t  be  manually  edited.  The  remaining  fields 
(Name,  Nationality,  Criminal  Record,  Education,  Employment,  Religion,  Address, 
Tribal  Affiliation,  Gender,  and  Age)  are  selectable  and  the  Soldier  may  complete 
any  combination  of  fields  before  submitting  the  report. 

Table  1  shows  the  data  elements  in  the  Checkpoint  app  along  with  the  range  of 
values. 


Table  1  Data  elements  and  values 


Data  element  name 

Possible  values 

Name 

Suspect’s  name 

Nationality 

Afghan,  Muslim, 

Criminal  record 

Has  record,  no  record 

Education 

High,  medium,  low 

Employment 

Cleric,  laborer,  professional,  retired,  unemployed 

Religion 

High,  medium,  low 

Times  Square  Village,  Viet  Nam  Village,  Vertol 

Address 

Village,  Hanover  Village,  Cook  Corner  Village,  Gredge  town, 
Utes  Village,  Horizon  Village 

Tribal  affiliation 

Baloch,  Hazara,  Pashtu,  Tajik 

Gender 

Male,  female 

Age 

20,  25,  30,  35,  40,  45,  50,  55 
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The  following  is  an  example  of  output  disseminated  from  the  Checkpoint  app 
(DSPro  required  XML  format). 
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<?xml  version-"l . 0"?> 

<Metadata> 

<Field> 

<FieldName  M©ssage_ID-  /FieldName> 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName:  Receiver_Time_Stamp  FieldName> 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldNarne:  Referred  Data  Object  Id</FieldName> 

<F i e 1 d Va 1 ue  >  APG<  F i e 1 dVa 1 u  e  > 

</Field> 

<Field> 

<FieldNarne  Referred  Data  Instance  Id  /FieldName> 
<FieldValue>41b9832c-6210-4e36-bdl2-980577a03d68:/FieldValue> 

</Field> 

<Field> 

<FieldName:  Pedigree-  /FieldNarne> 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldNarne:  Refers_To</FieldName> 

<F ieldVa lue >N0  REF_OB J-  'FieldValue> 

</Field> 

<Field> 

<FieldName>Prev  Msg  ID< /FieldName> 

<F i e 1 d Va 1 ue  >  DSP  ro- ARL , D  SPro . Checkpoi ntReport : SAMSUNG- SM-N 90 0A:3</Fiel dVa 1 u  e  > 

</Field> 

<Field> 

<FieldNarne;  Source  VFieidName> 

<F  i  e  1  dVa  1  ue  >  SAMSUNG- SM-N 9 0  0A<  /  F  i  e  1  dVa  1  u  e  > 

</Field> 

<Field> 

<FieldNarae  Source_Time_Stamp  FieldNarae> 
<FieldValue>1462300154921</FieldValue> 

</Field> 

<Field> 

<FieldName:  Expiration_Time-  /FieldNarae> 

<FieldValue>0</FieldValue> 

</Field> 

<Field> 

<FieldName  Relevant_Missions  :/FieldName> 

<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName:  Left  Upper  Latitude</FieldName> 

<FieldValue>39 . 473896</FieldValue> 

</Field> 

<Field> 

<FieldName  Left  Upper  Longitude  /FieldName> 

<FieldValue>-76 . 114525< /FieldValue> 
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</Field> 

<Field> 

<F ieldName>Right_Lower_Lat itude  '  Fie ldName  > 
<FieldValue>39 . 473896</FieldValue> 

</Field> 

<Field> 

<F ieldName>Right_Lower_Longitude  ; /F ieldName> 
<FieldValue>-76. 11452 5</FieldValue> 

</Field> 

<Field> 

<FieldName>Location< /Fie ldName > 

<FieldValue  Times  Square  Village  ;/FieldValue> 
</Field> 

<Field> 

<FieldName> Importance  'FieldName> 
<FieldValue>9. 330000  eldValue> 

</Field> 

<Field> 

<FieldName>Source  Reliability</FieldName> 
<FieldValue>l. 000000</FieldValue> 

</Field> 

<Field> 

<FieldName> Inf ormation_Content  /Fie ldName> 
<FieldValue>l . 000000</FieldValue> 

</Field> 

<Field> 

<F i e 1 dName>Data_Content  /F i e ldName> 

<FieldValue  Checkpoint_Report</FieldValue> 
</Field> 

<Field> 

<FieldName>Data  Format  ; /Fie ldName> 

<FieldVal  image/ jpeg  ieldValue> 

</Field> 

<Field> 

<F ieldNarne>Target  ID  : /FieldName> 
<FieldValueX/FieldValue> 

</Field> 

<Field> 

<FieldNarae>Target_Role  </FieldName> 
<FieldValuex/FieldValue> 

</Field> 

<Field> 

<FieldName>Target_Team  Fie ldName > 
<FieldValuex/FieldValue> 

</Field> 

<Field> 

<F i e ldName 'Classifications /Fie ldName> 
<FieldValue>Unclassif ied-/FieldValue> 

</Field> 

<Field> 

<FieldNan-  Description  rieldName> 
<FieldValue>Checkpoint  Report  App</FieldValue> 
</Field> 
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<rieid> 


<F  ieldName::  Node  Type<  /F  ieldName> 

<FieldValuex/FieldValue> 

</Field> 

<F ield> 

<FieldName>Track  ID</FieldName> 

<F ieldVa 1 ue ></ F io ldValue> 

</FieId> 

<F i e ld> 

<F  ieldMaina:  Application_M«tadata <  /Fie  IdName  > 

<F  ieldVa  1  tie  >  {  "  Name " : 11  Ha  shim  Ahmad  " ,  ''National  ity 1T :  "Afghan Ir  ,  "Tribal 

Affiliation"  :  "Baloch",  "Age"  :30,  "Criminal  Record1' :  "Has 

Record",  "Education":  "Low",  "Employment "  :  "Unemployed",  "Religon"  :  "High",  "Gender"  :  "Male" 

</FieldValue> 

</FieId> 

<Field> 

<FioldNamc:  Application  Metadata  Format <;/FieldNarae> 

<F  i  e  1  d  Va  I  u  e  >  appli  cat  ion  /  j  s  on<  /  F  i  e  1  d  Va  1  u  e  > 

</Field> 

</Metadata> 


Examining  the  XML  reveals  the  Checkpoint  content  is  located  in  the  “Application 
Metadata”  field  in  JSON  format.  This  format  was  selected  for  compatibility  with 
other  tools  under  development  within  ARL.  The  corresponding  JSON  schema  for 
parsing  the  Checkpoint  message  is  in  the  following. 
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"Sschema"  :  "http.:// j  son-schema  ■  or  g/draf  t-Q-1/.schemait  " , 

"title":  "Checkpoint  Report", 

"description":  "Attributes  Gathered  by  Checkpoint  Mobile  App", 
"type":  "object", 

"properties" :  { 

"Name":  { 

"description":  "Name  of  the  person", 

"type":  "string" 

}, 

"Nationality":  { 

"description":  "Nationality  of  the  person", 

"type":  "string" 

}, 

"Tribal  Affiliation":  { 

"description":  "Tribe  of  the  person", 

"type":  "string" 

}, 

"Criminal  Record":  { 

"description":  "Criminal  Record  of  the  person", 

"type":  "string" 

}, 

"Education":  { 

"description":  "Education  Level  of  the  person", 

"type":  "string" 

}, 

"Employment":  { 

"description":  "Job  of  the  person", 

"type":  "string" 

), 

"Religion":  { 

"description":  "Religion  of  the  person", 

"type":  "string" 

}, 

"Gender"  :  { 

"description":  "Gender  of  the  person", 

"type":  "string" 

}, 

"Age" :  { 

"description":  "Age  of  the  person", 

"type":  "integer" 


}, 

"required":  ["Name"), 

"optional":  ("Nationality",  "Tribal  Affiliation",  "Criminal  Record",  "Education", 
"Employment",  "Religion",  "Gender",  "Age"] 


2.3  Common  Features 

The  Spot  Report  and  Checkpoint  Report  apps  share  numerous  features  that 
streamline  the  Warfighter’s  report  generation  process: 

1)  Time  and  GPS  coordinates  included  in  the  reports  are  automatically 
gathered  from  the  smartphone. 
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2)  Ability  to  include  a  photograph  in  the  report.  The  photo  can  be  taken  during 
report  creation  using  the  smartphone  camera  or  selected  from  the  phone’s 
gallery.  This  feature  allows  the  analyst  to  include  a  visual  depiction  of  the 
report  content. 

3)  The  apps  function  regardless  of  network  connectivity.  Reports  will  be 
recorded  locally  within  the  device  and  disseminated  whenever  a  connection 
is  established. 

4)  Audio  may  be  recorded  from  within  the  apps.  This  allows  the  Soldier  to 
record  and  disseminate  recorded  conversations  providing  the  analyst 
maximum  context.  There  may  be  a  communication  barrier  during 
checkpoint  operations,  but  recording  conversations  prevents  information 
from  being  lost  in  the  chain  from  collection  to  analyst.  An  analyst  may  have 
expert  translators  available,  ready  to  evaluate  audio  recordings  of  interest. 
When  the  audio  feature  is  enabled,  the  corresponding  JSON  code  (Fig.  7)  is 
used  to  facilitate  inclusion  of  both  the  photo  and  audio  messages  in  the  data 
field. 

5)  The  apps  use  the  phone’s  built-in  speech-to-text  capabilities.  The  Soldier  is 
not  forced  to  attempt  to  type  on  the  phone’s  touch  keyboard  to  input  data. 
There  is  an  optional  stylus  that  may  be  used  to  navigate  the  apps  and  record 
text. 

6)  Both  apps  include  a  “one-touch”  Vol  recording  option.  Touching  the  Vol 
grid  on  the  app  sets  the  Source  Reliability  and  Information  Content  to  the 
corresponding  value.  Sliders  for  Source  Reliability  and  Information  Content 
are  also  available  in  case  isolated  control  of  each  field  is  desired. 

The  set  of  streamlined  usability  features  across  the  apps  is  designed  to  allow  the 
Soldier  to  focus  on  the  mission  and  avoid  struggling  with  the  technology. 

( 

"data" :  [ 

"picture" :  El 

"mimeType1* :  "image/  jpeg ■* t 
"bytes":  "base6 4 Encoded  Image" 

I  ]  .■ 

"audio":  [{ 

"  m  imeTy pe " :  "  aud,  i  of  rapeg " , 

"bytes":  "base 6 4 Encoded Audio" 

)] 

} 

1 


Fig.  7  Data  JSON  field 
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2.4  DSPro  Integration 


This  prototype  uses  DSPro  as  its  dissemination  service.  DSPro  is  a  technology 
developed  by  the  IHMC*  that  efficiently  and  proactively  disseminates  information 
to  consumers  by  means  of  replication  and  forwarding  policies.  The  proactive 
behavior  is  the  result  of  the  integration  of  policies  and  a  distributed-learning 
algorithm  that  takes  into  account  the  history  of  previously  requested  information, 
along  with  the  characteristics  of  the  collectors  and  the  mission.  As  new  information 
becomes  available,  DSPro  matches  it  against  the  mission  profile  and  pushes 
relevant  information  to  the  consumers.  Information  that  is  selected  to  be  pushed  is 
sorted  based  on  the  predicted  time  to  use  and  the  confidence  value  of  the 
prediction.! 

In  FY16,  ARL’s  Multilingual  and  Analysis  and  Battlefield  Information  Processing 
groups  collaborated  with  the  IHMC  to  expand  and  enhance  DSPro.  As  part  of  that 
project,  DSPro  was  integrated  into  the  Checkpoint  and  Spot  Report  apps.  In 
addition,  the  Vol  metric  along  with  its  components  (Information  Content  and 
Source  Reliability)  were  integrated  into  DSPro.  It’s  important  to  note  that  DSPro 
takes  the  Vol  score  it  receives  from  the  smartphone  apps  and  combines  it  with 
additional  data  from  other  sources  to  form  its  own  Vol  score. 

3.  Contour 


Contour  is  a  software  tool  developed  by  Decisive  Analytics  Corporation  (DAC)  in 
collaboration  with  ARL.  It  allows  an  intelligence  analyst  to  collect,  search,  and 
analyze  large  amounts  of  data.  It  automatically  processes  and  discovers 
relationships  within  the  ingested  data,  which  allows  the  analyst  to  save  time  and 
effort  deriving  actionable  intelligence.  Contour’s  workflow  is  based  on  the  open 
source  algorithms  in  Framenet/  Gate,  and  Annie. §  These  algorithms  allow  it  to 
generate  the  relationship  diagrams  and  social  network  maps. 

As  mentioned  previously,  modifying  Contour  was  challenging,  as  the  software  was 
a  “black  box”.  With  some  insight  from  DAC,  ARL  was  able  to  incorporate  Vol  into 
Contour  by  overriding  the  Date  field,  since  date  filtering  was  not  of  interest  in  this 
iteration.  Specifically,  the  year  portion  of  the  date  field  was  overridden  to  represent 
the  Vol  score  of  the  data.  For  example,  the  year  2000  would  represent  a  Vol  score 
of  “0”  and  the  year  2010  would  represent  a  Vol  score  of  “10”.  With  this  change 


The  Institute  for  Human  and  Machine  Cognition  is  a  not-for-profit  institute  of  the  Florida  University 
System  that  frequently  collaborates  with  ARL.  http://www.ihmc.us/. 

^  Getting  Started  with  DisServicePro,  Giacomo  Benincasa/Niranjan  Suri,  2015. 

^  https ://framenet. icsi.berkeley . edu/ fndrupal/. 

§  https://gate.ac.uk/. 
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implemented,  the  data  set  could  be  modified  to  include  the  Vol  score  for  use  with 
Contour. 

Figure  8,  shows  the  original  Contour  social  network  map  for  the  Ali  Baba  Data  Set. 
In  contrast,  Fig.  9  shows  the  Vol-enhanced  social  network  map  for  the  Ali  Baba 
Data  Set.  In  this  example,  the  Vol  filter  is  set  to  5  or  greater,  resulting  in  the  lower 
Vol  relationships  being  greyed  out.  With  Vol  enhancements  enabled,  an  analyst 
may  quickly  triage  the  information  and  identify  the  most  important  people, 
organizations,  and  locations.  The  links  in  the  graph  are  extracted  from  multiple 
reports,  but  ARL  enhanced  the  link  thickness  algorithm  to  reflect  the  highest  Vol 
score  from  amongst  those  reports. 
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Fig.  8  Contour;  no  Vol 


Approved  for  public  release;  distribution  is  unlimited. 


Fig.  9 


Contour;  Vol 


Another  issue  encountered  with  Contour  was  entity  recognition.  To  illustrate, 
Contour  does  not  recognize  Arabic  names.  This  issue  was  identified  when 
Contour’s  social  network  graph  was  compared  to  ground  truth  and  found  to  be 
incomplete.  To  correct  this,  the  Contour  gazetteer  or  “whitelist”  was  modified  to 
include  all  of  the  unique  names  and  locations  in  the  dataset.  This  method  resolved 
most  of  the  name  issues;  however,  a  few  names  had  to  be  modified  to  be  recognized 
by  Contour.  It  is  believed  that  the  upcoming  version  of  Contour  will  fix  this 
problem. 

Testing  the  enhanced  version  of  Contour  required  a  data  set  with  a  known  ground 
truth.  Consequently,  the  Ali  Baba  Data  Set  was  selected.  ARL  is  familiar  with  the 
Ali  Baba  Data  Set  from  past  experience.5  The  data  set  contains  625  messages  in 
individual  text  (.txt)  files,  which  contain  1  or  2  short  sentences.  As  mentioned 
previously,  the  data  set  had  to  be  manipulated  to  be  compatible  with  Contour.  This 
entailed  assigning  the  625  documents  a  Vol  score  (by  overriding  the  date  field)  and 
fixing  formatting  issues.  ARL  expertise  with  the  dataset  allowed  for  learned 
application  of  Vol  scores.  These  modifications  allowed  the  team  to  ingest  the  data 
set  into  Contour  and  successfully  exercise  the  resulting  relationship  graph  with  Vol 
filters. 

4.  Conclusions 


ARL  has  developed  a  prototype  system  that  incorporates  Vol  from  collection  to 
analysis.  This  system  is  a  candidate  platform  for  field  experiments  to  evaluate  the 
benefits  of  Vol. 

ARL’s  Checkpoint  and  Spot  Report  apps  allow  Soldiers,  as  data  collectors,  to  send 
Vol-rated  data,  derived  from  their  subject  matter  expertise,  from  the  field  back  to 
the  analyst.  The  data  traverses  the  DSPro  network,  which  may  add  additional  Vol- 
based  filtering,  before  being  analyzed  by  Vol-enhanced  tools,  such  as  the 
augmented  version  of  Contour. 

Simulations  suggest  that  Vol-rated  data  aid  the  analyst  in  processing  the  most 
valuable  intelligence  first,  which  is  an  important  component  sustaining  situational 
awareness.  This  prototype  will  allow  further  investigation  of  the  benefit  of  Vol  in 
a  field  environment.  If  future  field  exercises  are  successful,  this  would  be  the  first 
step  in  developing  a  system  for  aiding  the  analyst  to  rapidly  discover  the  most 
valuable  information  being  collected  real-time  in  the  field. 
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List  of  Symbols,  Abbrevations,  and  Acronyms 


app 

application 

ARL 

US  Army  Research  Laboratory 

DAC 

Decisive  Analytics  Corporation 

GPS 

global  positioning  system 

IHMC 

Institute  for  Human  and  Machine  Cognition 

JSON 

JavaScript  Object  Notation 

SME 

subject  matter  expert 

Vol 

Value  of  Information 

XML 

Extensible  Markup  Language 
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